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© An image conversion apparatus for converting 
and outputting the spatial resolution, temporal reso- 
lution, or image quality of compressed image data 
input thereto is provided. A compression-coded 
frame-unit image signal An input from the input 
signal line (10) is changed to real-time image data 
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Rn by an image decoding unit (1). A image coding 
unit (2) then converts the real-time image data Rn to 
compressed image data comprising fewer picture 
elements and having a different spatial or temporal 
resolution different from that of the real-time image 
data Rn. 
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BACKGROUND OF THE INVENTION 

1. Field of the invention 

The present invention relates to an image con- 
version apparatus for converting the spatial resolu- 
tion, temporal resolution or image quality of com- 
pressed image data to obtain compressed image 
data of a different spatial resolution, temporal reso- 
lution or image quality used for transmission or 
database storage of compressed images. 

2. Description of the prior art 

The massive volume of information carried by 
digital image signals makes high efficiency coding 
essential for transmitting or recording digital image 
signals. Various image compression techniques 
have therefore been proposed in recent years, and 
some of these techniques are also scalable. 
Scalability makes it possible for the user to use 
images at any desired spatial resolution, temporal 
resolution, or image quality, and thus enables, for 
example, both HDTV and standard TV signals to be 
alternatively received from a single transmission 
path in response to user requests. 

An image coding apparatus (including image 
conversion apparatuses) using MPEG, a conven- 
tional scalable image coding method, is described 
below with reference to Figs. 1A and 1B, block 
diagrams of a conventional MPEG-compatible im- 
age coding method. The image coding apparatus 
comprises a first image coder 7 shown in Fig. 1A, 
and a second image coder 8 shown in Fig. 1 B. The 
image data size and number of pixels that can be 
processed by the first image coder 7 differ from 
those of the second image coder 8. Note that in 
Figs. 1A and 1B the signal line indicated by the 
solid line is the video signal line, and the signal line 
indicated by the dotted line is the line for signals 
other than the video signal (including the so-called 
"side information" described below). 

The video (image) signal is an interlace- 
scanned image input in frame units. The video 
signal input to input terminal 70 in Fig. 1 A is an 
uncompressed digital video signal. The input image 
is first input to the first resolution converter 91 
shown in Fig. 1B, and converted to an image of 
half the resolution (number of pixels) both vertically 
and horizontally. The first frame coded is in- 
traframe coded without obtaining any frame dif- 
ference value. The input image data is passed 
through the differencer and applied to the DCT 
mode evaluator 82 and DCT processor 83. The 
DCT mode evaluator 82 detects the amount of 
motion in the image and determines whether frame 
or field unit DCT should be used by, for example, 
obtaining the inter-line difference in two-dimension- 



al block units. The result of this operation is input 
to the DCT processor 83 as the DCT mode in- 
formation. 

The DCT processor 83 applies a DCT in either 
5 frame or field unit based on the DCT mode in- 
formation, and converts the image data to a con- 
version coefficient. Quantizer 84 quantizes the con- 
version coefficient supplied from the DCT proces- 
sor 83, and outputs to the variable length coder 85 
10 and inverse quantizer 86. The variable length coder 
85 variable length codes the quantized signal, and 
outputs the result through the multiplexer 93 shown 
in Fig. 1A to the transmission path. The quantized 
conversion coefficient is then inverse quantized by 
is the inverse quantizer 86, and input to the inverse 
DCT processor 87. The inverse DCT processor 87 
restores the input data to real-time image data, and 
stores the real-time image data to the frame buffer 
88. 

20 Because there is usually a high correlation 

between images, energy is concentrated in the 
conversion coefficients corresponding to the low 
frequency component after DCT is applied. As a 
result, by quantizing the high frequency compo- 

25 nents to which the human visual system (HVS) is 
less sensitive with large quantization noise, and 
quantizing the more important low frequency com- 
ponents with minimal quantization noise, image de- 
terioration can be minimized, and the compressed 

30 image data size can be smaller (higher coding 
efficiency). In addition, the intraframe correlation is 
high when there is little motion in interlaced im- 
ages, and when motion is large the inter-frame 
correlation is low but the intra-field correlation is 

35 high. It follows that interlaced images can also be 
efficiently coded by using this characteristic of 
interlaced images to appropriately switch between 
frame and field unit DCT processing. 

Images following the intraframe coded frame 

40 are then coded by calculating a predicted value for 
each frame, and then coding the difference be- 
tween the actual frame value and the predicted 
value, i.e., coding the prediction error. The coding 
apparatus typically obtains the image used for pre- 

45 dictive coding from the first resolution converter 91 , 
and inputs the image to the motion detector 81; the 
motion detector 81 obtains the image motion vec- 
tors in two-dimensional block units using a com- 
mon full search method. 

so The frame buffer 88 and motion compensator 

89 then generate predicted values compensating 
for motion in the next frame in two-dimensional 
blocks using the motion vectors detected by the 
motion detector 81. The difference between the 

55 predicted value and the actual image input data is 
calculated to obtain the prediction error, which is 
coded with the same method used for intraframe 
coding. The motion vectors used for motion com- 
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pensation, the motion compensation information ex- 
pressing the parameters for block unit motion com- 
pensation, and the DCT mode information are ap- 
plied as "side information" to the variable length 
coder 85, and are transferred to the decoder (not 
shown in the figures) through multiplexer 93 with 
the coded coefficient. 

Because prediction error is optimally coded by 
means of the above image coding apparatus, the 
energy decreases and higher coding efficiency can 
be achieved in comparison with such direct image 
data coding schemes as intraframe coding. 

In contrast with this, the first image coder 7 
(Fig. 1A) is an image compression coder whereby 
the image resolution is not changed. The first im- 
age coder 7 shown in Fig. 1A comprises, similarly 
to the first image coder 7 in Fig. 1B, a motion 
detector 71, DCT mode evaluator 72, DCT proces- 
sor 73, quantizer 74, variable length coder 75, a 
inverse quantizer 76, inverse DCT processor 77, 
adder, frame buffer 78, and motion compensator 
79. 

This image coder 7 essentially compression 
codes digital image signals in the same way as the 
second image coder 8, but differs from the second 
image coder 8 in the ability to use low resolution 
images to generate the predicted values. Predicted 
value generation itself is , handled by the motion 
compensator 79, and to accomplish this, the low 
resolution image of the previous frame stored in 
the frame buffer 88 is input to the image resolution 
converter 92 (Fig. 1B) for resolution doubling in 
both vertical and horizontal directions. The motion 
compensator 79 then uses an image the same size 
as the original image obtained by the image resolu- 
tion converter 92 as one of the predicted value 
candidates. The motion compensator 79 shown in 
Fig. 1A calculates the difference between the origi- 
nal image and the predicted value read from the 
frame buffer 78, and between the original image 
and the output of the second image resolution 
converter 92, and selects the smaller difference for 
input to the DCT processor 73. 

By means of the first image coder 7 coding 
high resolution images as thus described, parts 
such as low resolution image areas do not need to 
be coded, and coding efficiency can be increased. 
The high and low resolution coded images are then 
multiplexed by the multiplexer 93 and output to the 
transmission path. 

The decoder (not shown in the figures) obtains 
a low resolution image by extracting and decoding 
the low resolution coded image data from a single 
type of coded image data. In addition, by extracting 
both the high and low resolution coded image data 
for decoding, the high resolution image data can 
also be obtained. Depending on the situation, the 
user can thus switch between receiving low and 



high resolution images. Such resolution images are 
explained in MPEG-2 (ISO/IEC JTC1/SC29 N659, 
-ISO/IEC CD 13818-2: Information technology - Ge- 
neric coding of moving pictures and associated 

5 audio information - Part 2: Video", 1993.12). 

For example, multiplexer 93 produces a mul- 
tiplexed signal containing a HDTV signal from the 
variable length coder 75 and a standard TV signal 
from the variable length coder 85. 

10 According to the prior art, the image coders 7 

and 8 shown in Figs. 1A and 1B may be provided 
at the television broadcasting station. In this case, 
the television broadcasting station will need to pre- 
pare both a HDTV signal and a standard TV signal 

75 for the same television program. 

Achieving scalability with the above image cod- 
ing method is faced with the following problems, 
however. 

First, the quality of high resolution images de- 

20 teriorates. If the transmission rate of low resolution 
compressed image data is b, and that of high 
resolution compressed image data is c, the com- 
bined transmission rate a of images compressed 
by means of this conventional coding method will 

25 be a = b + c. Tests have shown that when the 
image quality of decoded images is compared be- 
tween images coded using all of transmission rate 
a for the high resolution compressed images, and 
images coded using transmission rates b and c to 

30 separately code compressed image data of two 
different resolutions, the quality of the image coded, 
using all of transmission rate a is clearly superior. 

Second, the decoding apparatus on the receiv- 
ing side becomes more complex. More specifically, 

35 it is not possible to decode high resolution com- 
pressed image data with the conventional coding 
method without using separate decoders for the 
high and low resolution images. 

40 SUMMARY OF THE INVENTION 

Therefore, an object of the present invention is 
to provide an image conversion apparatus whereby 
a decoding apparatus of simple constitution, free of 
45 image deterioration, and having scalability can be 
achieved. 

To achieve the aforementioned object, an im- 
age conversion apparatus according to the present 
invention comprises an image decoder for decod- 

so ing and restoring to real-time image data Rn one or 
more compressed image data An (where n is a 
positive integer) containing compressed frame-unit 
video signals and input to the image decoder; and 
an image coder for converting the real-time image 

55 data Rn input thereto from the image decoder to 
one or more types of compressed image data Bn 
each having a different spatial resolution, and out- 
putting the compressed image data Bn. 
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An image conversion apparatus according to 
the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 
frame-unit video signals and input to the image 
decoder; and an image coder for converting the 
real-time image data Rn input from the image 
decoder to one or more types of compressed im- 
age data Bn each having a different temporal reso- 
lution, and outputting the compressed image data 
Bn. 

An image conversion apparatus according to 
the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 
frame-unit video signals and input to the image 
decoder; and an image coder for converting the 
real-time image data Rn input from the image 
decoder to one or more types of compressed im- 
age data Bn each having a different quantization 
level, and outputting the compressed image data 
Bn. 

An image conversion apparatus according to . 
the present invention is one of the preceding three 
embodiments further characterized by compressing 
the image data using side information, which is not 
image data, obtained by decoding the compressed 
image data An during the process converting and 
compressing the real-time image data Rn to the 
compressed image data Bn. 

An image conversion apparatus according to 
the present invention comprises a storage means 
for storing one or more compressed image data An 
(where n is a positive integer) containing com- 
pressed frame-unit video signals; and an image 
coder for converting the compressed image data 
An input thereto from the storage means to one or 
more types of compressed image data Bn each 
having a different spatial resolution, and outputting 
the compressed image data Bn. 

An image conversion apparatus according to 
the present invention comprises a storage means 
for storing one or more compressed image data An 
(where n is a positive integer) containing com- 
pressed frame-unit video signals; and an image 
coder for converting the compressed image data 
An input thereto from the storage means to one or 
more types of compressed image data Bn each 
having a different temporal resolution, and output- 
ting the compressed image data Bn. 

An image conversion apparatus according to 
the present invention comprises a storage means 
for storing one or more compressed image data An 
(where n is a positive integer) containing com- 
pressed frame-unit video signals; and an image 
coder for converting the compressed image data 



An input thereto from the storage means to one or 
more types of compressed image data Bn each 
having a different quantization level in the ortho- 
gonal transform coefficient, and outputting the com- 

5 pressed image data Bn. 

An image conversion apparatus according to 
the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 

io n is a positive integer) containing compressed 
frame-unit video signals and input to the image 
decoder; first through k image coders for convert- 
ing the real-time image data Rn input thereto from 
the image decoder to compressed image data Bn1 

75 ... Bn/r each having a different spatial resolution, 
and outputting compressed image data Bn1 ... Bn/c; 
and a selector for alternatively selecting the image 
data of the image decoder and first through k 
image coders. 

20 An image conversion apparatus according to 

the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 

25 frame-unit video signals and input to the image 
decoder; first through k image coders for convert- 
ing the real-time image data Rn input from the 
image decoder to compressed image data Bn1 ... 
Bn/c each having a different temporal resolution, 

30 and outputting compressed image data Bnl ... Bn/c; 
and a selector for alternatively selecting the image 
data of the image decoder and first through k 
image coders. 

An image conversion apparatus according to 

35 the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 
frame-unit video signals and input to the image 

40 decoder; first through k image coders for convert- 
ing the real-time image data Rn input from the 
image decoder to compressed image data Bn1 ... 
Bn/r each having a different quantization level, and 
outputting compressed image data Bn1 ... Bn/r; and 

45 a selector for alternatively selecting the image data 
of the image decoder and first through k image 
coders. 

An image conversion apparatus according to 
the present invention comprises an image decoder 

so for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 
frame-unit video signals and input to the image 
decoder; first through k image coders for convert- 

55 ing the real-time image data Rn input from the 
image decoder to compressed image data Bn1 ... 
Bn/c each having a different temporal resolution, 
and outputting compressed image data Bn1 ... Bn/c; 
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and a request input terminal for inputting a control 
signal setting the resolution of the first through k 
image coders to a particular value. 

An image conversion apparatus according to 
the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 
frame-unit video signals and input to the image 
decoder; first through k image coders for convert- 
ing the real-time image data Rn input from the 
image decoder to compressed image data Bn1 ... 
Bn/f each having a different spatial resolution, and 
outputting compressed image data Bn1 ... Bnfc; and 
a request input terminal for inputting a control 
signal setting the resolution of the first through k 
image coders to a particular value. 

An image conversion apparatus according to 
the present invention comprises an image decoder 
for decoding and restoring to real-time image data 
Rn one or more compressed image data An (where 
n is a positive integer) containing compressed 
frame-unit video signals and input to the image 
decoder; first through k image coders for convert- 
ing the real-time image data Rn input from the 
image decoder to compressed image data Bn1 ... 
Bn/c each having a different quantization level, and 
outputting compressed image data Bn1 ... Bn/f; and 
a request input terminal for inputting a control 
signal setting the quantization level of the first 
through k image coders to a particular value. 

An image conversion apparatus according to 
the present invention comprises a variable length 
decoder for variable length decoding one or more 
compressed image data An (where n is a positive 
integer) containing compressed frame-unit video 
signals and input to the variable length decoder, 
and generating a conversion coefficient; plural co- 
efficient selectors for selecting from among the 
conversion coefficients output by the variable 
length decoder the conversion coefficient corre- 
sponding to the desired image resolution; and plu- 
ral variable length coders for variable length coding 
the data of the plural coefficient selectors. 

In the image conversion apparatus according to 
the invention as described above, the compressed 
image data An of the frame-unit image signals is 
input to the image decoder for decoding and re- 
conversion to the real-time image data Rn. When 
this real-time image data Rn is then input from the 
image decoder, the image coder converts the input 
data to one or more types of compressed image 
data Bn. each of which has a different spatial 
resolution, temporal resolution, or quantization lev- 
el. 

In the image conversion apparatuses according 
to the invention as described above, the image 
decoder reads the compressed image data An of 



the frame-unit image signals from the storage 
means for decoding and re-conversion to the real- 
time image data Rn. When this real-time image 
data Rn is then input from the image decoder, the 
5 image coder converts the input data to one or more 
types of compressed image data Bn, each of which 
has a different spatial resolution, temporal resolu- 
tion, or quantization level. As a result, plural images 
of different converted resolutions can be read by 
10 storing only one type of high resolution com- 
pressed image data in the storage means. 

In the image conversion apparatuses according 
to the invention as described above, the com- 
pressed image data An of the frame-unit image 
75 signals is input to the image decoder for decoding 
and re-conversion to the real-time image data Rn. 
When this real-time image data Rn is then input 
from the image decoder, the image coder converts 
the input data to one or more types of compressed 
20 image data Bn, each of which has a different spa- 
tial resolution, temporal resolution, or quantization 
level. When the compressed image data is then 
decoded on the receiver side, the selector is ap- 
propriately switched to select the compressed im- 
25 age data for decoding and outputting images of a 
particular resolution. It is therefore possible to 
transfer the image data without increasing the 
transfer rate. 

In the image conversion apparatuses according 
30 to the invention as described above, the com- 
pressed image data An of the frame-unit image 
signals is input to the image decoder for decoding 
and re-conversion to the real-time image data Rn. 
When this real-time image data Rn is then input 
35 from the image decoder, the image coder converts 
the input data to one or more types of compressed 
image data Bn at the resolution input from the 
request input terminal. 

In the image conversion apparatuses according 
40 to the invention, the conversion coefficients de- 
coded by the variable length decoder can be se- 
lected according to the resolution of the image to 
be reproduced. 

As described above, the image quality on the 
45 reproduction side does not deteriorate because 
high resolution compressed image data can be 
transferred using the allowable limits of the transfer 
rate. Furthermore, because compressed image 
data of a particular resolution can be selected and 
so output, the constitution of the decoding apparatus 
is also simplified. Normally, decoding apparatuses 
that can decode high resolution images can also 
decode low resolution images, and compressed 
image data coded using the image conversion ap- 
55 paratus of the present invention can therefore also 
be decoded by means of a single decoding ap- 
paratus for high resolution images. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully 
understood from the detailed description given be- 
low and the accompanying diagrams wherein: 
Figs. 1A and 1B taken together as shown in Fig. 
1 show a block diagram of the image conversion 
apparatus according to the prior art; 
Figs. 2A, 2B, 20 and 2D taken together as 
shown in Fig. 2 show a block diagram of the 
image conversion apparatus of the first embodi- 
ment of the present invention; 
Figs. 3A, 3B and 3C taken together as shown in 
Fig. 3 show views similar to Figs. 2B, 2C and 
2D, respectively, but are for the image conver- 
sion apparatus of the second embodiment of the 
present invention; 

Fig. 4 is a block diagram of an image conver- 
sion apparatus according to the third embodi- 
ment of the present invention; 
Fig. 5 show a block diagram similar to that 
shown in Fig. 2B, but is for the image conver- 
sion apparatus of the third embodiment of the 
present invention; 

Figs. 6A and 6B taken together as shown in Fig. 
6 show views similar to Figs. 2C and 2D, re- 
spectively, but are for the image conversion 
apparatus of the fifth embodiment of the present 
invention; 

Fig. 7 show a block diagram similar to that 
shown in Fig. 2B, but is for the image conver- 
sion apparatus of the sixth embodiment of the 
present invention; 

Fig. 8 is a flow chart showing an image recom- 
pression method according to the first modifica- 
tion of the embodiment shown in Figs. 3A and 
3B; 

Fig. 9 is a flow chart showing an image recom- 
pression method according to the second modi- 
fication of the same; 

Fig. 10 shows a block diagram of an image 

recompression apparatus according to the third 

modification of the same, and particularly for 

carrying out the flow chart of Fig. 8; 

Fig. 11 shows a block diagram of the difference 

coefficient memory shown in Fig. 10; 

Fig. 12 shows a block diagram of an image 

recompression apparatus according to the fourth 

modification of the same; 

Fig. 13 shows a block diagram of an image 
recompression apparatus according to the fifth 
modification of the same; 

Fig. 14 shows a diagram of an image recording 
apparatus according to the sixth modification of 
the same; 

Fig. 15 is a view similar to Fig. 10, but showing 
a variation thereof; 
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Fig. 16 is a view similar to Fig. 12, but showing 
a variation thereof; and 

Fig. 17 is a view similar to Fig. 13, but showing 
a variation thereof. 

5 

DESCRIPTION OF PREFERRED EMBODIMENTS 

The first embodiment of an image conversion 
apparatus according to the present invention is 

10 described below with reference to Figs. 2A, 2B, 2C 
and 2D taken together as shown in Fig. 2. Fig. 2A 
is a block diagram of an image coding unit ?', 
which is substantially the same as that shown in 
Fig. 1A; Fig. 2B is a block diagram of the image 

75 decoding unit 1; Fig. 2C is a block diagram of the 
first image coding unit 2; and Fig. 2D is a block 
diagram of the second image coding unit 3. 

According to the present invention, it may be 
so arranged that the television broadcasting station 

20 can be installed only with the arrangement shown 
in Fig. 2A to prepare and broadcast only the HDTV 
signal, which is the compression-coded high reso- 
lution image data An (where n is a positive integer). 
A suitable transducer shown in Figs. 2B, 2C and 

25 : 2D may be located outside the broadcasting sta- 
tion, so that the transducer produces not only the 
HDTV signal An from line 10, but also standard TV 
signal Bn1 and coarse TV signal Bn2 for the same 
television program for variety of end users. It is 

30 noted that the circuit of Fig. 2A can be provided at 
an on-demand service center or at a network ser- 
vice. The transducer is described in detail below 
with reference to Figs. 2B, 2C and 2D. 

Referring to Fig. 2B, the compression-coded 

35 high resolution image data An, such as for the 
HDTV signal, is transferred by means of signal line 
10. The image decoding unit 1 decodes the com- 
pressed image data transferred by said signal line 
10 to convert the compressed image data to the 

40 original real-time image data Rn. Similarly to a 
common image decoder, the image decoding unit 

1 comprises a variable length decoder 11, inverse 
. quantizer 12, inverse DCT processor 13, adder 13*, 

frame buffer 14, and simplified motion compensa- 

45 tor 15. 

The high resolution digital image signal Rn 
decoded by the image decoding unit 1 is input to 
the first image coding unit 2 (Fig. 2C), which gen- 
erates compressed image data Bnl, converted to a 

so first resolution, such as for the standard TV signal. 
It is to be noted that the hardware configuration of 
said image coding unit 2 is simpler than that of a 
common image coder, said first image coding unit 

2 specifically comprising subtractor 20, DCT pro- 
55 cessor 21, quantizer 22, variable length coder 23, 

inverse quantizer 24, inverse DCT processor 25, 
adder 25\ frame buffer 26, simplified motion com- 
pensator 27, a first resolution converter 28, and 
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scaling circuit 29. 

The high resolution digital image signal de- 
coded by the image decoding unit 1 is input 
through the first resolution converter 28 to the 
second image coding unit 3 (shown in Fig. 2D) for 5 
generating the compressed image data Bn2, con- 
verted to a second resolution, such as for the 
coarse TV signal. The second image coding unit 3 
outputs compressed image data having an image 
data size (measured by the number of horizontal w 
and vertical picture elements) smaller than that 
obtained by the first image coding unit 2. Com- 
pared with the first image coding unit 2, the second 
image coding unit 3 is designed for image quality, 
and comprises a motion detector 31, DCT mode is 
evaluator 32, and motion compensator 39 in addi- 
tion to the DCT processor 33, quantizer 34, vari- 
able length coder 35, inverse quantizer 36, inverse 
DCT processor 37, adder 37\ frame buffer 38, and 
second resolution converter 40. 20 

The resolution converter is disclosed in U.S. 
Patent No. 4,789,893 to Weston; U.S. Patent ap- 
plication Serial No. 08/185244 filed January 24, 
1994 and assigned to the same assignee as the 
present application, and STANDARDS CONVER- 25 
SION BETWEEN 1250/50 AND 625/50 TV SYS- 
TEMS from BBC Research Department UK, the 
entire content of which are expressly incorporated 
by reference herein. 

The operation of the image conversion appara- 30 
tus according to the first embodiment of the 
present invention thus comprised is described next 
below. It is here assumed that the high resolution 
compressed image data An from the circuit of Fig. 
2A is input to the image conversion apparatus 35 
through signal line 10 as shown in Fig. 2B. 

The compressed image data An is output along 
the signal line 10, but it is simultaneously input to 
the image decoding unit 1 for re-conversion to real- 
time image data. Specifically, the variable length 40 
decoder 11 variable length decodes the com- 
pressed image data and decodes the side informa- 
tion. The decoded image data is then inverse quan- 
tized by the inverse quantizer 1 2. The inverse DCT 
processor 1 3 executes an inverse DCT operation in 45 
frame or field units based on the DCT mode in- 
formation contained in the side information, and 
generates a conversion coefficient. The result of 
this operation is restoration of the image data to 
real-time image data. so 

Because this data is coded differentially, the 
frame buffer 14 and motion compensator 15 then 
generate a predictive image using the motion vec- 
tor and motion compensation mode information 
contained in the side information. This predicted 55 
image is then added to the output data from the 
inverse DCT processor 1 3 to generate the decoded 
real-time image data. The structure of the motion 
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compensator 15 is simple compared with the struc- 
ture of the motion compensators 79 and 89 of the 
image coding apparatus according to the prior art. 
This is because it is not necessary to provide the 
image decoding unit 1 with circuitry for selecting 
the appropriate motion compensation mode, i.e., a 
square error calculator, because the motion com- 
pensation mode is already determined by the cod- 
ing apparatus on the transmission sided and the 
predictive image can be simply generated accord- 
ing to the motion compensation mode information 
decoded from the compressed image data. 

The resolution of the decoded image data is 
then reduced one-half (1/2) both vertically and hori- 
zontally by the first resolution converter 28 (Fig. 
2C). The reduced-resolution image is compression 
coded by a method of the prior art. However, the 
side information obtained during data decoding, 
including the DCT mode information, motion com- 
pensation information, and motion vector informa- 
tion, is applied to the scaling circuit 29 whereby the 
information is scaled and used for coding. This 
side information is obtained for image blocks or 
other image units of a predetermined size. As a 
result, if for example the image resolution is re- 
duced to 1/4 the original image resolution, the side 
information for four high resolution image blocks 
corresponds to one low resolution image block. 

Scaling is possible by, for example, interpolat- 
ing a central value from the mean, mode, and 
median of the target blocks (four blocks in this 
example) and surrounding blocks. The hardware 
configuration can thus be simplified and a simpli- 
fied motion compensator used because the motion 
detector is made unnecessary by using the de- 
coded and extracted side information for coding. 

The output Rn of the first resolution converter 
28 is also input to the second resolution converter 
40 shown in Fig. 2D, and the resolution is thereby 
reduced by a further 1/2 vertically and horizontally. 
The output of the second resolution converter 40 is 
used to generate the compressed image data using 
a method of the prior art. The second image cod- 
ing unit 3 differs from the first image coding unit 2 
in that it recalculates the side information. While 
the first image coding unit 2 scales the decoded 
and extracted side information and uses the scaled 
side information for coding, error occurs because 
this side information is not strictly obtained using a 
low resolution image, and this side information can 
become a cause of image deterioration particularly 
when the compression ratio is high. It is possible, 
however, to prevent image deterioration by recal- 
culating the side information as in the second im- 
age coding unit 3. Thus, the first and second image 
coding units 2 and 3 are mutually complementary, 
the first image coding unit 2 simplifying the hard- 
ware configuration and the second image coding 
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unit 3 emphasizing image quality, and can there- 
fore be used selectively as required. 

High resolution images can thus be efficiently 
coded by means of the embodiment described 
above because coding is possible using all of the 
allotted transfer rate a. Furthermore, because the 
high resolution compressed image input data is 
output as is while also outputting the image data 
converted to plural low resolution compressed im- 
age data, both high and low resolution images can 
be decoded using a single high resolution decod- 
ing apparatus. 

It is noted that the first and second resolution 
converters 28 and 40 are provided for converting 
the spatial resolution. Instead of the spatial resolu- 
tion converters 28 and 40, it is possible to employ 
temporal resolution converters. Such a temporal 
resolution converter is disclosed in MPEG-2, which 
is expressly incorporated by reference herein. 

The second embodiment of an image conver- 
sion apparatus according to the invention is de- 
scribed below with reference to Figs. 3 A, 3B and 
3C. It is to be noted that Figs. 3A, 3B and 3C show 
corresponding portions of Figs. 2B, 2C and 2D, 
respectively, of the first embodiment, and that the 
circuit of Fig. 2A can be connected to the circuit of 
Fig. 3A as a source of the compressed image data 
An. Specifically, Fig. 3A is a block diagram of the 
image decoding unit 1 of the image conversion 
apparatus in the second embodiment of the inven- 
tion, and is substantially the same as that shown in 
Fig. 2B; Fig. 3B is a block diagram of the quantiza- 
tion controller 4 and first image coding unit 2A; and 
Fig. 3C is a block diagram of the second image 
coding unit 3A. 

This second embodiment differs from the first 
embodiment in that a quantization controller 4 is 
provided in place of the resolution converters 28 
and 40. Whereas the high resolution compressed 
image data is converted to low resolution com- 
pressed image data in the image conversion ap- 
paratus according to the first embodiment, the 
transfer rate is converted by changing the quantiza- 
tion level according to the first and second image 
coding units 2A and 3A to control the image quality 
while holding the resolution constant in this second 
embodiment. Image quality deteriorates when the 
quantization level is reduced, but communication 
costs can be reduced because the transfer rate 
simultaneously drops. This second embodiment 
thus achieves the effects of the first embodiment 
above while also enabling control of the transfer 
rate. 

Variations and modifications of the second em- 
bodiment, particularly the circuit portion enclosed 
by a double dot dash line shown in Figs. 3A and 
3B, will be further described later in connection 
with Figs. 8-19. 



The third embodiment of an image conversion 
apparatus according to the invention is described 
below with reference to Fig. 4. As shown in Fig. 4, 
the image conversion apparatus comprises a first 

5 image coding unit 2B and a second image coding 
unit 3B. The circuit of Fig. 2A can be connected to 
the circuit of Fig. 4 as a source of the compressed 
image data An. 

This first image coding unit 2B selects the first 

io coefficient (e.g., the low frequency coefficient) from 
the DCT conversion coefficients in the compressed 
digital image data input thereto from the signal line 
10. and generates the compression-coded image 
data. The second image coding unit 3 B selects the 

is second coefficient (e.g., the conversion coefficient 
whereby the pixel count is reduced) from the im- 
age data input from the first image coding unit 2B, 
and likewise generates the compression-coded im- 
age data. 

20 The first image coding unit 2B comprises a 

simplified variable length decoder 201, a first co- 
efficient selector 202, and a first simplified variable 
length coder 203. The second image coding unit 
3B comprises a second coefficient selector 301 

25 and a second variable length coder 302. 

The operation of an image conversion appara- 
tus thus comprised is described below. As does 
the second embodiment described above, this third 
embodiment outputs compressed image data of 

30 different image quality levels, but controls the im- 
age quality by selecting the DCT coefficient of the 
high resolution compressed image data. DCT may 
be thought of as a type of frequency analysis; as a 
result, the lower the frequency to which the DCT 

35 coefficient (vertical and horizontal) corresponds, the 
more sensitive the HVS is to data loss, and the 
greater the effect on the human visual perception 
of image quality. 

The compressed image data is input from the 

40 signal line 10 to the simplified variable length de- 
coder 201 for decoding only the DCT coefficient 
part. The first coefficient selector 202 leaves only 
the coefficients corresponding to the low frequen- 
cies, and abandons the other coefficients. For ex- 

45 ample, when there are 64 coefficients (8 horizontal 
and 8 vertical), the first coefficient selector 202 
selects only 25 coefficients, specifically the 5 x 5 
horizontal and vertical coefficients starting from the 
low frequency component, and abandons the re- 

50 maining coefficients. The first simplified variable 
length coder 203 variable length codes these 25 
coefficients again, converting the data to com- 
pressed image data with a reduced transfer rate for 
output. When there are, for example, 16 coeffi- 
55 cients (4x4 vertically and horizontally), the second 
image coding unit 3B selects only four coefficients, 
specifically the 2 x 2 horizontal and vertical coeffi- 
cients starting from the low frequency component, 
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and abandons the remaining coefficients. 

It is therefore possible by means of this em- 
bodiment to achieve the same effects as the sec- 
ond embodiment above by means of an even sim- 
pler configuration. 

The fourth embodiment of an image conversion 
apparatus according to the invention is described 
below with reference to Fig. 5, which shows a 
modification of the circuit of Fig. 2B. In the first 
embodiment, the source of the compressed image 
data An is provided by the circuit of Fig. 2A, but in 
this embodiment, the compressed image data An is 
provided from a memory of storage unit 5. When 
compared with the first embodiment shown in Figs. 
2A-2D, the only difference is that the fourth em- 
bodiment has a storage unit 5, instead of the circuit 
shown in Fig. 2A, as a source of compressed 
image data An. 

The storage unit 5 shown in Fig. 5 is a 
database for storing the compressed image data 
An, and is comprised of, for example, a large- 
capacity digital signal recording and reproducing 
apparatus and an optical disk apparatus. 

The image decoding unit 1 decodes the com- 
p resse( j image data reproduced from the storage 
unit 5, and restores the compressed image data to 
the original real-time digital image data. The struc- 
ture and operation thereafter is the same as the 
first embodiment 

Whereas the high resolution compressed im- 
age data is input from a transmission path (signal 
line 10) from the circuit of Fig. 2A in the first 
embodiment, the high resolution compressed im- 
age data is stored to the storage unit 5 in the 
present embodiment. The stored compressed im- 
age data can therefore be read as required for 
conversion and output at a desired resolution, and 
image data of various output resolutions can thus 
be obtained. 

If the database (storage unit 5) were to store 
discretely compressed image data for each of the 
resolutions reproducible in the scalable range of 
resolutions, the database would require a massive 
storage capacity. This problem is avoided in the 
present embodiment of the invention, however, be- 
cause high image quality, low resolution com- 
pressed image data can be output by means of a 
simple conversion process from the high resolution 
compressed image data, and it is therefore suffi- 
cient to store only the high resolution compressed 
image data in the storage unit 5. 

The fifth embodiment of an image conversion 
apparatus according to the invention is described 
below with reference to Figs. 6A and 6B. It is to be 
noted that Figs. 6A and 6B show corresponding 
portions of Figs. 2C and 2D, respectively, of the 
first embodiment, and that the circuit of Figs. 2A 
and 2B can be connected to the circuit of Fig. 6A 



to complete the entire structure of the fifth embodi- 
ment. Specifically, Fig. 6A is a block diagram of 
the first image coding unit 2; and Fig. 6B is a block 
diagram of the second image coding unit 3. The 
5 only difference of the fifth embodiment with respect 
to the first embodiment is that the fifth embodiment 
has a key input device 61 to manually change the 
resolution level of the first and second resolution 
converters 28 and 40. 
io A control signal specifying the resolution of the 

converted image is generated by a key input de- 
vice 61, and is applied to the first resolution con- 
verter 28 (Fig. 6A) and to the second resolution 
converter 40 (Fig. 6B). Whereas in the first embodi- 
75 ment above the resolution is converted to 1/2 and 
1/4, respectively, by the first and second resolution 
converters 28 and 40, the resolution can be 
changed in the present embodiment in response to 
a user request. 
20 It is therefore possible for the user to obtain 

compressed image data at the desired resolution 
within the reproducible resolution limits. 

The sixth embodiment of an image conversion 
apparatus according to the invention is described 
25 below with reference to Fig. 7. It is to be noted that 
Fig. 7 shows a corresponding portion of Fig. 2B of 
the first embodiment, and that the circuit of Fig. 2A 
from the first embodiment and the circuit of Figs. 
6A and 6B from the fifth embodiment can be 
30 connected to the circuit of Fig. 7 to complete the 
entire structure of the sixth embodiment. The only 
difference of the sixth embodiment with respect to 
the fifth embodiment is that the sixth embodiment 
has a selector 62 for selecting any one of different 
35 compressed image data An, Bn1 and Bn2, which 
may be corresponding to the HDTV signal An, 
standard TV signal Bn1, and coarse TV signal Bn2. 

As shown in Fig. 7, selector 62 is provided in 
the output path of the image conversion apparatus 
40 for alternatively selecting the signal line 10 (An), 
the output from the first image coding unit 2 (Bn1), 
or the output from the second image coding unit 3 
(Bn2) according to the control signal input from the 
key input device 61. Whereas in the first embodi- 
45 ment the outputs of the first and second image 
coding units 2 and 3 are output directly to the 
transmission path, the output can be switched by 
the selector 62 to output compressed image data 
in response to a user request applied via the key 
so input device 61 . 

It is therefore possible for the user to obtain 
compressed image data at the desired resolution 
even when the capacity of the transmission path to 
the viewing position is limited. 
55 It is to be noted that the image coders and 

decoders described hereinabove have been de- 
scribed using a DCT coding method, but it will be 
obvious that the present invention shall not be so 
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limited and other coding/decoding methods can 
also be used, including orthogonal transform, vec- 
tor quantization, sub-band coding, and DPCM. 

It shall be further noted that while spatial reso- 
lution conversion was used for resolution conver- 
sion by way of example in the first, fourth, fifth, and 
sixth embodiments above, the present invention 
shall not be so limited and the same effects can be 
obtained using other conversion methods, including 
changing the number of frames or temporal resolu- 
tion conversion. In addition, the above embodi- 
ments have been described as discretely applying 
spatial resolution or image quality conversion for 
resolution conversion, but the present invention 
shall not be so limited and spatial, temporal, and/or 
image quality conversions can be used in various 
combinations thereof. 

The above embodiments have been further de- 
scribed assuming a high resolution compressed 
image data input, but it is also possible to con- 
stitute the present invention to generate com- 
pressed image data with enhanced resolution using 
a low resolution compressed image data input. 

The fourth, fifth, and sixth embodiments above 
were also described in combination with the image 
conversion apparatus described in the first embodi- 
ment, but shall not be so limited and can specifi- 
cally be comprised with the image conversion ap- 
paratus of the second or third embodiments. 

The embodiments have also been described 
comprising two types of image coders each for the 
temporal resolution, spatial resolution, and quan- 
tization level. The spatial resolution conversion is 
done by the first and second resolution converters 
28 and 40 shown in Figs. 2C and 2D. The quantiza- 
tion level change, so as to change the resolution, is 
done by the quantize control 4 and quantizers 22 
and 34 shown in Figs. 3B and 3C. The temporal 
resolution conversion is done by a temporal resolu- 
tion converter disclosed in MPEG-2. It is also pos- 
sible, however, to provide plural image coders, e.g., 
first, second, ... image coders, and to alter- 
natively select the image coder appropriate for the 
current operation. 

By means of an image conversion apparatus 
according to the present invention, high resolution 
images can be efficiently coded because coding 
can be executed using the full transfer rate allotted. 
Both high and low resolution images can also be 
decoded using a single high resolution decoding 
apparatus because the high resolution compressed 
image input data is output directly and converted to 
compressed image data of plural low resolutions. 

By means of an image conversion apparatus 
according to the present invention, the compressed 
image data stored to the storage unit is read as 
required for conversion to and output at a particular 
resolution, and image data can thus be output at a 



wide range of image resolutions. It is therefore also 
not necessary to provide the storage unit with a 
massive storage capacity. 

By means of an image conversion apparatus 

5 according to the present invention, the selector can 
switch the output to output the desired compressed 
image data by applying the appropriate command 
to the key input device in response to a request 
from the user of the image conversion apparatus. It 

70 is therefore possible for the user to obtain com- 
pressed image data at a particular resolution even 
when the capacity of the transmission path to the 
viewing site is limited. 

By means of an image conversion apparatus 

75 according to the present invention, the image reso- 
lution can be changed in response to a request 
from the user of the image conversion apparatus, 
and the user can therefore obtain compressed im- 
age data at a particular resolution. 

20 By means of an image conversion apparatus 

according to the present invention, it is possible to 
further simplify the hardware required for the image 
conversion apparatus because the image resolution 
can be changed by selecting the conversion coeffi- 

25 cient. 

There is also no image deterioration resulting 
from any of the above embodiments because high 
resolution images can be coded using the entire 
transfer rate allotted. Images of different resolutions 

30 can also be decoded using only a single high 
resolution image decoding unit 1, and the load on 
the decoding unit can be reduced. 

Next, variations and modifications of the sec- 
ond embodiment, particularly the circuit portion en- 

35 closed by a double dot dash line shown in Figs. 3A 
and 3B, will be described. 

It is to be noted that while the modifications are 
described using, by way of example, only the com- 
pression-coded bit stream obtained by the inter- 

40 frame predictive DCT coding method, the image 
recompression method and image recompression 
apparatus of the present invention shall not be 
limited to this method. Other compression schemes 
to which the present invention can also be applied 

45 include other compression coding methods using 
interframe prediction (including subband and wave- 
let conversion), and compression coding methods 
using prediction between picture elements or other 
data units (including differential pulse code modula- 

so tion (DPCM)). 

The basic concept of the modifications are 
disclosed in U.S. Patent application serial No. 
08/252,173 filed June 1, 1994 by Boon Choong 
Seng (European Patent Publication No. 627 858 A3 

55 published December 7, 1994), the entire content of 
which is expressly incorporated by reference here- 
in. 
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(Modification 1) 

The first modification of the invention is de- 
scribed below with reference to Fig. 8, showing a 
flow chart used to describe an image recompres- 
sion method according to the first modification of 
the invention. 

This process starts when the compression-cod- 
ed image data bit stream is input at step #40. The 
quantized DCT coefficient a[i] and the first quan- 
tization step q[i] are then extracted from the bit 
stream. Note that "/" is a value from 1 ... N, "AT is 
the number of DCT coefficients for the target 
blocks, and the value of N varies according to the 
target block. The DCT coefficient a[i] is obtained 
by a DCT of the source image or prediction error, 
and then quantizing the result at q[i]. Furthermore, 
while i * j, the first quantization step q[i] may be 
equal to other quantization steps such that q[i] = 
QUI 

The quantization step qp] is then multiplied by 
the coefficient a[i] for inverse quantization (step 
#42). A compensation coefficient z[i] is then sub- 
tracted from the inverse quantized coefficient bp] 
obtained by inverse quantization (step #43). This 
compensation coefficient z[i] is the recompression 
error occurring from recompression of the preced- 
ing image data (the compensation coefficient is 
obtained in step #48 as described below). 

The compensated coefficient b'p] is then quan- 
tized in step #44 by a second quantization step q N - 
[i] to obtain the quantization coefficient c [i]. As 
with the first quantization step, while i * j, the 
second quantization steps q N [i] may be equal such 
that q N [i] = q N p]. Note also that the second quan- 
tization step q N p] is normally controlled so that the 
image bit stream after recompression contains less 
data than does the bit stream of the original input 
video. The resulting quantization coefficient c[i] and 
quantization step q N p] are then applied to a vari- 
able length coder in step #50. 

The method of obtaining this compensation 
coefficient is described below. This compensation 
coefficient is the quantization error resulting from 
quantization at the second quantization step q N p]. 
To obtain this coefficient, inverse quantization is 
first applied at step #45, i.e., coefficient c[i] is 
multiplied by q N [i] to generate inverse quantized 
coefficient dp]. Because the compensation coeffi- 
cient z[i] is subtracted from the inverse quantized 
coefficient bp] in step #43, the inverse quantized 
coefficient dp] (from step #45) is compensated by 
adding zp] to d[i] in step #46, resulting in com- 
pensated coefficient e[i]. Note that the coefficient 
e[i] is restored by re-quantizing bp]. The quantiza- 
tion error caused by re-quantization at q^i] can 
therefore be determined by obtaining the difference 
between e[i] and bp]. This quantization error is the 



compensation coefficient z'p] applied to the next 
picture. In other words, compensation coefficient z'- 
[i] is obtained in the present frame, and compensa- 
tion coefficient zp] is obtained in the previous 

5 frame. It is to be noted that the compensation 
coefficient z'p] can also be obtained by subtracting 
the compensated coefficient b'[i] from the inverse 
quantized coefficient dp]. 

The compensation coefficients z'p] are then 

io stored temporarily (step #50) for use as the com- 
pensation signal when recompressing the next pic- 
ture. 

The above sequence is repeated for each 
block in the current picture, and the compensation 
15 coefficients z'p] are stored for each block. Before 
recompressing the next picture, the compensation 
coefficients z'p] are read from memory and used 
as the compensation coefficients zp] in the above 
process. 

20 Note that steps #43 and #46 are not executed 

for intraframe coded blocks because these frames 
are entirely coded without referencing the previous 
image. In addition, the above process is executed 
in the DCT domain, but the DCT coefficients may 

25 be inversely converted and the process executed 
in the spatial domain. 

It should also be noted that the inverse quan- 
tization applied in step #42 may be omitted. In this 
case, bp] = a[i] in step #42, and the second 

30 quantization step q N p] is multiplied by qp]. Then, in 
step #50, qp] is output in place of q N p]. 

(Modification 2) 

35 The second modification of the invention is 

described below with reference to Fig. 9, showing a 
flow chart used to describe an image recompres- 
sion method according to the second modification 
of the invention. 

40 This process starts when the compression-cod- 

ed image data bit stream is input at step #70. The 
quantized DCT coefficient ap] is then extracted 
from the bit stream. Note that as above T is a 
value from 1 ... N, "AT is the number of DCT 

45 coefficients for the target blocks, and the value of N 
varies according to the target block. The DCT 
coefficient ap] is obtained by a DCT of the source 
image or prediction error, and then quantizing the 
result 

so A compensation coefficient z[i] is then sub- 

tracted from the DCT coefficient ap] (step #72). 
This compensation coefficient zp] is the recom- 
pression error occurring from recompression of the 
preceding image data (the compensation coeffi- 

55 cient is obtained in step #78 as described below). 

n K n compensated coefficients a*[i], where K £ 
N, are then selected and held (coefficients up]), 
and the other coefficients are discarded (step #74). 
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By thus rounding-down the coefficients, the picture 
can be compressed with even greater efficiency. 
Furthermore, the value of K varies according to the 
image block, and is controlled such that the image 
bit stream after recompression contains less data 
than the bit stream of the original picture input. The 
resulting coefficient u[i] is then output in step #80. 

The method of obtaining this compensation 
coefficient is described below. This compensation 
coefficient is the error resulting from discarding a 
number of compensated coefficients a'[i]. To obtain 
this error, the selected coefficients u[i] are com- 
pensated by adding the compensation coefficient 
z[i] thereto, obtaining compensated coefficients w- 
[i]. Note that the compensated coefficients w[i] 
correspond to the coefficients held after coefficient 
rounding-down in step #74. As a result, the error 
introduced by the rounding-down step can be de- 
termined by obtaining the difference between w[i] 
and a[i], which is performed in step #78 and results 
in the compensation coefficients z'[i]. It is to be 
noted that the compensation coefficients z'[i] can 
also be obtained by subtracting the compensated 
coefficients a'[i] (coefficients a[i] compensated by 
z[i]) from the selected coefficients u[i]. 

The compensation coefficients z'[i] are then 
stored temporarily (step #80) for use as the com- 
pensation signal when recompressing the next pic- 
ture. 

The above sequence is repeated for each 
block in the current picture, and the compensation 
coefficients z'[i] are stored for each block. Before 
recompressing the next picture, the compensation 
coefficients z*[i] are read from memory and used 
as the compensation coefficients z[i] in the above 
process. 

Note that steps #72 and #76 are not executed 
for intraframe coded blocks because these frames 
are entirely coded without referencing the previous 
image. 

(Modification 3) 

The third modification of the invention is de- 
scribed below with reference to Fig. 10, showing a 
block diagram of an image recompression appara- 
tus 300 which carries out the steps (shown in Fig. 
8) described in the first modification. As shown in 
Fig. 10, this image recompression apparatus com- 
prises a variable length decoder 110, a rate con- 
troller 120, a first inverse quantizer 130, a first 
adder 210, a quantizer 140, a variable length coder 
150, a multiplexer 160, a second inverse quantizer 
170, a second adder 220, a third adder 230, and a 
coefficient difference memory 180. 

The bit stream of coded image data is input 
from the input terminal 100 to the variable length 
decoder 110, which analyzes the incoming bit 



stream to select and decode to numeric values the 
quantization step q[i] and quantized DCT coeffi- 
cients a[i]. Note that as above T is a value from 1 
... N, "AT is the number of DCT coefficients for the 

5 target blocks, and the value of N varies according 
to the target block. 

The variable length decoder 110 outputs the 
decoded values to the first inverse quantizer 130 
via line 2010. The rest of the data in the incoming 

10 bit stream (i.e., the data other than q[i] and a[i]) is 
throughput from the variable length decoder 110 
via line 2000 to the multiplexer 160. 

The first inverse quantizer 130 inverse quan- 
tizes a[i] at quantization step q[i], resulting in the 

75 inverse quantized coefficient b[i] output to the first 
adder 210 via line 2020. The first adder 210 sub- 
tracts the compensation coefficient z[i], which is 
generated from the past image data and is stored 
in the coefficient difference memory 180, from b[i], 

20 resulting in compensated inverse quantized coeffi- 
cients b'[i]. These coefficient b'[i] are then input to 
the quantizer 140 through line 2022 for quantization 
by a new quantization parameter q N [i] to generate 
the quantized coefficient c[i]. 

25 Both the quantized coefficient c[i] and the 

quantization parameter q N [i] are input to the vari- 
able length coder 1 50 via line 2030, and converted 
thereby to variable length code, which is output to 
the multiplexer 160. 

30 The multiplexer 160 multiplexes the variable- 

length, coded quantized coefficient c[i] and the 
quantization parameter q N [i] input from the variable 
length coder 150 via line 2040 with the other data 
in the incoming bit stream input from the variable 

35 length decoder 110 via line 2000, and outputs the 
multiplexed bit stream. The resulting multiplexed 
bit stream is thus a recompressed version of the 
incoming bit stream. 

Note that the value of the quantization step q N - 

40 [i] is normally determined by counting the bits in 
the output of the variable length coder 150, and the 
rate controller 120 setting the quantization step q N - 
[i] accordingly to achieve a particular bit rate. 

Note, further, that the first inverse quantizer 

45 130 can be omitted. In this case, signals b[i] and a- 
[i] on line 2020 are equal, and the result of mul- 
tiplying q[i] by q N [i] is output to the multiplexer 160 
over Line 2040 in place of q N [i]. 

The quantization step q N [i] and coefficient c[i] 

so are also input to the second inverse quantizer 170 
via line 2032 for inverse quantization of c[i] at q N [i], 
thus generating inverse quantized coefficient d[i]. 
The second adder 220 then adds the compensation 
coefficient z[i] generated according to the past 

55 image data to d[i], and outputs the sum to the third 
adder 230. 

The third adder 230 obtains the coefficient 
difference z*[i] from the sum input from the second 
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adder 220 and b[i] input from Line 2024. The 
coefficient differences z'[i] are then stored in the 
coefficient difference memory 180. These coeffi- 
cient differences are then used as the compensa- 
tion coefficients for recompressing the next picture. 

As shown in Fig. 15, it is to be noted that the 
coefficient differences z'[i] can also be obtained by 
subtracting the output b'[i] from the first adder 210 
from the inverse quantized coefficients d[i] output 
from the second inverse quantizer 170. This con- 
figuration also makes it possible to eliminate one 
adder. 

The preferred modification of the coefficient 
difference memory 180 is described next with ref- 
erence to Fig. 11, showing a block diagram of the 
coefficient difference memory 180. As shown in 
Fig. 11, this coefficient difference memory 180 
comprises an inverse orthogonal transform proces- 
sor, such as an inverse OCT, 182, a frame memory 
184, and an orthogonal transform processor, such 
as a DCT, 186. The coefficient differences z'[i] 
input from the input terminal 181 are DCT coeffi- 
cients. These coefficients are inversely converted 
by the inverse orthogonal transform processor 182 
to restore the spatial domain difference signals. 
The results are stored to the frame memory 184, 
and are used when recompressing the next picture. 

The operation whereby the next picture is re- 
compressed is considered next. Motion compensa- 
tion is required to obtain a spatial domain dif- 
ference signal from the frame memory 184 be- 
cause the prediction signal is obtained by motion 
compensation. This motion information is input 
from the variable length decoder 1 1 0 via line 2080. 

The difference signal for the target block is 
then fetched from the frame memory 1 84 based on 
the motion information, and output to the ortho- 
gonal transform processor 186 via line 2094. The 
spatial domain difference signal is then converted 
to the conversion domain to generate the coeffi- 
cient difference. This coefficient difference is out- 
put via line 2070 to the first adder 210, and used 
as the compensation coefficient. When motion 
compensation is applied with a precision of one- 
half picture element or greater, the difference sig- 
nals stored to the frame memory 184 are interpo- 
lated and up-sampled before motion compensation. 

Note that it is also possible to directly store the 
DCT domain coefficients z'[i] to the frame memory 
184, and apply motion compensation in the DCT 
domain to generate the compensation coefficients. 
In this case both the inverse orthogonal transform 
processor 182 and orthogonal transform processor 
186 can be eliminated. 

While this modification has been described 
with reference to interframe predictive coding, it is 
also possible to use other DPCM techniques re- 
ferencing pixels or other data units. In this case the 



signals are not processed in the conversion do- 
main, and the inverse orthogonal transform proces- 
sor 182 and orthogonal transform processor 186 in 
Fig. 11 can be eliminated. 

5 

(Modification 4) 

The fourth modification of the invention is de- 
scribed below with reference to Fig. 12, showing a 
10 block diagram of an image recompression appara- 
tus 300 according to the fourth modification of the 
invention. As shown in Fig. 12, this image recom- 
pression apparatus comprises a variable length de- 
coder 110, a rate controller 120, a first inverse 
is quantizer 130, a first inverse orthogonal transform 
processor 240, a first adder 210, an orthogonal 
transform processor 250, a quantizer 140, a vari- 
able length coder 150, a multiplexer 160, a second 
inverse quantizer 170, a second inverse orthogonal 
20 transform processor 260, a second adder 220, a 
third adder 230, and a frame memory 270 for 
storing difference signal. 

The bit stream of coded image data is input 
from the input terminal 100 to the variable length 
25 decoder 110. which analyzes the incoming bit 
stream to select and decode to numeric values the 
quantization step q[i] and quantized DCT coeffi- 
cients a[i]. Note that as above "/" is a value from 1 
... N, "AT is the number of DCT coefficients for the 
30 target blocks, and the value of N varies according 
to the target block. 

The variable length decoder 110 outputs the 
decoded values to the first inverse quantizer 130 
via Line 3010. The rest of the data in the incoming 
35 bit stream (i.e., the data other than q[i] and a[i]) is 
throughput from the variable Length decoder 110 
via line 3000 to the multiplexer 160. 

The first inverse quantizer 130 inverse quan- 
tizes a[i] at quantization step q[i], resulting in the 
40 inverse quantized coefficient bfi], which is output to 
the first inverse orthogonal transform processor 240 
via line 3012. The first inverse orthogonal transform 
processor 240 converts the DCT domain coeffi- 
cients b[i] to the spatial domain, obtaining a first 
45 spatial signal s[i]. This spatial signal s[i] is output 
via line 3020 to the first adder 210. 

The first adder 210 subtracts the compensation 
coefficient z[i], which is generated from the past 
image data and is stored in the difference signal 
so memory 270, from spatial signal s[i], resulting in 
compensated spatial signal s'[i]. The spatial signals 
s'[i] are input via line 3022 to the orthogonal trans- 
form processor 250, and converted thereby to DCT 
domain coefficients b'[i]. The DCT coefficients b*[i] 
55 are then input to the quantizer 140 through line 
3024 for quantization by a new quantization param- 
eter q N [i] to generate the quantized coefficient c[i]. 
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Both the quantized coefficient c[i] and the 
quantization parameter q N [i] are input to the vari- 
able length coder 150 via line 3030, and converted 
thereby to variable length code, which is output to 
the multiplexer 160. 

The multiplexer 160 multiplexes the variable- 
length-coded quantized coefficient c[i] and the 
quantization parameter qw[i] input from the variable 
length coder 150 via line 3040 with the other data 
in the incoming bit stream input from the variable 
length decoder 110 via line 3000, and outputs the 
multiplexed bit stream. The resulting multiplexed 
bit stream is thus a recom pressed version of the 
incoming bit stream. 

Note that the value of the quantization step q N - 
[i] is normally determined by counting the bits in 
the output of the variable length coder 150, and the 
rate controller 120 setting the quantization step q N - 
[i] accordingly to achieve a particular bit rate. 

The quantization step q N [i] and coefficient c[i] 
are also input to the second inverse quantizer 170 
via line 3032 for inverse quantization of c[i] at qwDL 
thus generating inverse quantized coefficient d[i]. 
Coefficient d[i] is then output to the second inverse 
orthogonal transform processor 260. The second 
inverse orthogonal transform processor 260 con- 
verts the DCT domain coefficients d[i] to spatial 
domain signals s"[i]. The second adder 220 then 
adds the compensation coefficient z[i] generated 
according to the past image data to s"[i], and 
outputs the sum to the third adder 230. 

The third adder 230 obtains the difference sig- 
nal z f [i] from the sum input from the second adder 
220 and the spatial signal s[i] input from the first 
inverse orthogonal transform processor 240 via line 
3026. The difference signals z'[i] are then stored in 
the difference signal memory 270. These differ- 
ence signals are then used as the compensation 
signal for recompressing the next picture. 

As show in Fig. 16, it is to be noted that the 
difference signals z*[i] can also be obtained by 
subtracting the output s'[i] from the first adder 210 
from the output s"[i] of the second inverse or- 
thogonal transform processor 260. This case also 
makes it possible to eliminate one adder. 

When the next picture is recompressed, the 
difference signal for the target block is fetched 
from the difference signal memory 270 based on 
the motion information input from the variable 
length decoder 110 via line 3080, output to the first 
adder 210 via line 3070, and used as the com- 
pensation signal. When motion compensation is 
applied with a precision of one-half picture element 
or greater, the difference signals stored to the 
difference signal memory 270 are interpolated and 
up-sampled before motion compensation. 



(Modification 5) 

The fifth modification of the invention is de- 
scribed below with reference to Fig. 13, showing a 

5 block diagram of an image recompression appara- 
tus 300 according to the fifth modification of the 
invention. As shown in Fig. 13, this image recom- 
pression apparatus comprises a variable length de- 
coder 1 10, a rate controller 120, a first adder 210, a 

70 coefficient selector 280, a variable length coder 
150, a multiplexer 160, a second adder 220, a third 
adder 230, and a coefficient difference memory 
180. 

The bit stream of coded image data is input 

15 from the input terminal 100 to the variable length 
decoder 110, which analyzes the incoming bit 
stream to select and decode to numeric values the 
quantized DCT coefficients a[i]. Note that as above 
T is a value from 1 ... N, "AT is the number of 

20 DCT coefficients for the target blocks, and the 
value of N varies according to the target block. 

The variable length decoder 110 outputs the 
decoded values to the first adder 210 via line 4010. 
The rest of the data in the incoming bit stream (i.e., 

25 the data other than a[i]) is throughput from the 
variable length decoder 110 via line 4000 to the 
multiplexer 160. 

The first adder 210 subtracts the compensation 
coefficient z[i], which is generated from the past 

30 image data and is stored in the coefficient dif- 
ference memory 180, from a[i], resulting in com- 
pensated coefficient a'[i]. A data block containing N 
coefficients a^i] (where / = 1 ... N) is input to the 
coefficient selector 280 through line 4020. 

35 The coefficient selector 280 selects and holds 

n K n compensated coefficients a'[i], where K £ N, 
from the N coefficients a'[i] (these becoming the 
selected coefficients u[i]), and discards the other 
coefficients. By thus rounding-down the coefri- 

40 cients, the picture can be compressed with even 
greater efficiency. 

The selected coefficients u[i] are input to the 
variable length coder 150 via line 4030, converted 
to variable length code, and output to the mul- 

45 tiplexer 160. 

The multiplexer 160 multiplexes the variable- 
length-coded selected coefficients u[i] input from 
line 4040 with the other data in the incoming bit 
stream input from the variable length decoder 110 

50 via Line 4000, and outputs the multiplexed bit 
stream. 

Note that the value of K varies according to the 
block, and is normally determined by counting the 
bits in the output of the variable length coder 150, 
55 and the rate controller 120 setting K accordingly to 
achieve a particular bit rate. 

Coefficients u[i] are also input to the second 
adder 220 via line 4032. The second adder 220 
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then adds the compensation coefficient z[i] gen- 
erated according to the past image data to u[i], and 
outputs the compensation coefficient w[i] to the 
third adder 230. 

The third adder 230 obtains the coefficient 
difference z'[i] from the output w[i] of the second 
adder 220 and a[i] input from the variable length 
decoder 110 via line 4012. The coefficient differ- 
ences z f [i] are then stored in the coefficient dif- 
ference memory 180. These coefficient differences 
are then used as the compensation coefficients for 
recom pressing the next picture. 

As shown in Fig. 17, it is noted that the coeffi- 
cient differences z'[i] can also be generated by 
subtracting the output a'[i] of the first adder 210 
from the output u[i] of the coefficient selector 280. 
In this case, one adder can be eliminated. 

The preferred modification of the coefficient 
difference memory 180 is as shown in Fig. 11 and 
described above with respect to the third modifica- 
tion of the invention. 

(Modification 6) 

The sixth modification of the invention is de- 
scribed below with reference to Fig. 14, showing a 
block diagram of an image recording apparatus 
according to the sixth modification of the invention. 
As shown in Fig. 14, this image recording appara- 
tus comprises an external input terminal 330, se- 
lector switches 350 and 360, an image recompres- 
sion apparatus 300, and a recording apparatus 340. 
Note that the image recompression apparatus 300 
is an image recompression apparatus according to 
the present invention as shown in Figs. 10, 12, or 
13. 

The bit stream is input from the external input 
terminal 330. When recording in the normal record- 
ing mode, the first selector switch 350 is closed to 
terminal 310, and the other selector switch 360 is 
closed to terminal 320. In this case the bit stream 
is not processed by the image recompression ap- 
paratus, is sent directly to the recording apparatus 
340, and is recorded thereby to the recording me- 
dium (magnetic tape, optical disk, or other). 

To record in an extended-play mode, however, 
the first selector switch 350 is closed to terminal 
100, and the other selector switch 360 is closed to 
terminal 200. When the switches are thus posi- 
tioned, the switching circuit effectively completes 
the apparatus described in the third through fifth 
modifications above, and the bit stream recompres- 
sed by the image recompression apparatus 300 is 
recorded by the recording apparatus 340. By thus 
switching the path of the incoming bit stream, the 
bit stream can be recorded directly in a normal 
recording mode, or can be recompressed for re- 
cording in an extended-play recording mode. 



As will be known from the above descriptions 
of the preferred modifications, an input bit stream 
can be recompressed to a bit stream of a different 
bit rate by means of the image recompression 

s apparatus and image recompression method of the 
present invention without completely decoding and 
reproducing the bit stream. As a result, there is 
virtually no delay in recompression throughput. It is 
also possible to prevent the propagation of errors 

70 caused by recompression, and thus to reduce im- 
age quality deterioration, because the prediction 
error of the current picture is compensated based 
on an error signal generated by recompressing the 
past picture before recompressing the current pic- 

75 ture. 

Therefore, the above modifications provides 
the apparatus and method for recompressing a 
compression-coded image bit stream to a lower bit 
rate (with higher compression efficiency) without 
20 propagating errors by recompressing the current 
image after compensating the prediction error of 
the current image using the error signal resulting 
from recompressing the image before. 

The above modifications can be summarized 
25 as follows. 

According to one modification, a compressed 
image data quantized by a first quantization param- 
eter is inverse quantized using said first quantiza- 
tion parameter to generate the first inverse quan- 
30 tized image data. A compensation signal generated 
from the past image data is then subtracted from 
the first inverse quantized image data, quantized 
using a second quantization parameter, and inverse 
quantized using said second quantization param- 
35 eter to generate the second inverse quantized im- 
age data, which is output. A difference signal is 
then generated from the second inverse quantized 
image data and first inverse quantized image data 
for use as the compensation signal of the next 
40 image data. Preferably, a compensation signal gen- 
erated from the past image data is added to the 
second inverse quantized image data, and then the 
difference signal is generated from the first inverse 
quantized image data and the compensated sec- 
45 ond inverse quantized image data. 

According to another modification, a compen- 
sation coefficient generated according to the past 
image data is subtracted from a first conversion 
coefficient block contained in the compressed or- 
50 thogonal transform image data, thereby generating 
a second conversion coefficient block. A predeter- 
mined number of coefficients is then extracted 
from the second conversion coefficient block to 
generate and output a third conversion coefficient 
55 block. A difference coefficient block is then gen- 
erated from the third conversion coefficient block 
and the first conversion coefficient block for use as 
the compensation coefficient of the next image 

15 
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data. Preferably, a compensation coefficient gen- 
erated from the past image data is added to the 
third conversion coefficient block, and the differ- 
ence coefficient block is then generated from the 
first conversion coefficient block and the compen- 
sated third conversion coefficient block. 

The propagation of errors caused by requan- 
tizing is prevented by means of an image recom- 
pression apparatus as described below. 

The image recompression apparatus comprises 
a variable length decoder, a first inverse quantizer, 
a first adder, a quantizer, a variable length coder, a 
multiplexer, a second inverse quantizer, a second 
adder, a third adder, and a difference coefficient 
memory. 

The variable length decoder decodes a first 
quantization parameter and a first quantized coeffi- 
cient from the coded image input data, transfers 
said decoded data to the first inverse quantizer, 
and transfers the data other than said first quantiza- 
tion parameter and first quantized coefficient to the 
multiplexer. The first inverse quantizer inverse 
quantizes the first quantized coefficient using the 
first quantization parameter to generate a first in- 
verse quantized coefficient. The first adder sub- 
tracts a compensation coefficient generated ac- 
cording to the past image data and stored in the 
difference coefficient memory from the first inverse 
quantized coefficient, and inputs the difference to 
the quantizer for quantization using the second 
quantization parameter to generate a second quan- 
tized coefficient. The variable length coder converts 
the second quantization parameter and the second 
quantized coefficient input thereto to variable 
length code, and outputs said variable length code 
to the multiplexer. The multiplexer multiplexes and 
outputs the input variable length code with the 
other data input from the variable iength decoder. 
The second inverse quantizer inverse quantizes the 
second quantized coefficient using the second 
quantization parameter to generate a second in- 
verse quantized coefficient. The second adder 
adds the compensation coefficient generated ac- 
cording to the past image data to the second 
inverse quantized coefficient; the third adder gen- 
erates a difference coefficient from the first inverse 
quantized coefficient and the compensated second 
inverse quantized coefficient, and stores said dif- 
ference coefficient to a difference coefficient mem- 
ory. This difference coefficient is used as the com- 
pensation coefficient of the next image data. 

The propagation of errors caused by requan- 
tizing can also be prevented by means of an image 
recompression apparatus as described below. 

The image recompression apparatus comprises 
a variable length decoder, a first inverse quantizer, 
a first inverse orthogonal transform processor, a 
first adder, an orthogonal transform processor, a 



quantizer, a variable length coder, a multiplexer, a 
second inverse quantizer, a second inverse or- 
thogonal transform processor, a second adder, a 
third adder, and a difference signal memory. 

5 The variable length decoder decodes a first 

quantization parameter and a first quantized coeffi- 
cient from the coded image input data, transfers 
said decoded data to the first inverse quantizer, 
and transfers the data other than said first quantiza- 

70 tion parameter and first quantized coefficient to the 
multiplexer. The first inverse quantizer inverse 
quantizes the first quantized coefficient using the 
first quantization parameter to generate a first in- 
verse quantized coefficient. The first inverse or- 

75 thogonal transform processor then converts the first 
inverse quantized coefficient to a first spatial signal. 
The first adder subtracts a compensation signal 
generated according to the past image data and 
stored in the difference coefficient memory from 

20 the first spatial signal. The orthogonal transform 
processor applies an orthogonal transform to the 
resulting difference signal, and inputs the resulting 
coefficient to the quantizer for quantization using 
the second quantization parameter to generate a 

25 second quantized coefficient. The variable length 
coder converts the second quantization parameter 
and the second quantized coefficient input thereto 
to variable length code, and outputs said variable 
length code to the multiplexer, which multiplexes 

30 and outputs the input variable length code with the 
other data. The second inverse quantizer inverse 
quantizes the second quantized coefficient using 
the second quantization parameter to generate a 
second inverse quantized coefficient. The second 

35 inverse orthogonal transform processor then con- 
verts the second inverse quantized coefficient to a 
second spatial signal. The second adder adds the 
compensation signal generated according to the 
past image data to the second spatial signal; and 

40 the third adder generates a difference signal from 
the first spatial signal and the compensated second 
spatial signal, and stores said difference signal to 
the difference signal memory. The resulting dif- 
ference signal is used as the compensation signal 

45 of the next image data. 

The propagation of errors caused by eliminat- 
ing conversion coefficients can also be prevented 
by means of an image recompression apparatus 
according to the present invention as described 

50 below. 

This image recompression apparatus com- 
prises a variable length decoder, a first adder, a 
coefficient selector, a variable length coder, a mul- 
tiplexer, a second adder, a third adder, and a 

55 difference coefficient memory. 

The variable length decoder decodes a first 
conversion coefficient block from the coded image 
input data, transfers said first conversion coefficient 
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block to the first adder, and transfers the data other 
than said first conversion coefficient block to the 
multiplexer. The first adder subtracts a compensa- 
tion coefficient generated according to the past 
image data and stored in the difference coefficient 5 
memory from the first conversion coefficient block 
to generate a second conversion coefficient block. 
The coefficient selector extracts a particular num- 
ber of coefficients from the second conversion co- 
efficient block, and forms a third conversion coeffi- w 
cient block. The variable length coder converts the 
third conversion coefficient block input thereto to 
variable length code, and outputs said variable 
length code to the second adder and to the mul- 
tiplexer. The multiplexer multiplexes the input vari- 75 
able length code with other data, and outputs the 
multiplexed bit stream. The second adder adds the 
compensation coefficient generated according to 
the past image data to the third conversion coeffi- 
cient block; the third adder then generates a dif- 20 
ference coefficient from the first conversion coeffi- 
cient block and the compensated third conversion 
coefficient block, and stores said difference coeffi- 
cient to the difference coefficient memory. The 
resulting difference coefficient is used as the com- 25 
pensation coefficient of the next image data. 

It is therefore possible by means of the image 
recompression method and the image recompres- 
sion apparatus of the present invention to recom- 
press an input bit stream to a bit stream of a 30 
different bit rate without completely decoding the 
input bit stream and reproducing the coded im- 
ages. As a result, there is substantially no addi- 
tional delay imposed by the recompression opera- 
tion. In addition, the propagation of errors caused 35 
by recompression can be prevented, and further 
image quality deterioration can be reduced, be- 
cause recompression is applied to the current im- 
age after compensating the prediction error of the 
current image by the error signal generated by 40 
recompressing the previous image. 

The invention being thus described, it will be 
obvious that the same may be varied in many 
ways. Such variations are not to be regarded as a 
departure from the spirit and scope of the inven- 45 
tion, and all such modifications as would be ob- 
vious to one skilled in the art are intended to be 
included within the scope of the following claims. 

Claims 50 

1. An image conversion apparatus for converting 
a primary compressed image data An (where n 
is a positive integer) containing compressed 
frame-unit video signals to at Least one secon- 55 
dary compressed image data Bn having a res- 
olution different from that of the primary com- 
pressed image data An, said image conversion 



apparatus comprising: 

an image decoder (1) for decoding said 
primary compressed image data An, having a 
first degree of resolution, to decoded image 
data Rn; and 

a first image coder (2; 2A; 2B) having a 
first resolution converter means (28; 4, 22; 202) 
for converting the decoded image data Rn, 
input thereto from the image decoder, to a first 
secondary compressed image data Bn1 having 
a second degree of resolution, and outputting 
the first secondary compressed image data 
Bn1. 

2. An image conversion apparatus according to 
Claim 1, wherein said resolution converter 
means is a spatial resolution converter means 
(28, 40). 

3. An image conversion apparatus according to 
Claim 1, wherein said resolution converter 
means is a temporal resolution converter 
means. 

4. An image conversion apparatus according* to 
Claim 1, wherein said resolution converter 
means is a quantization level converter means 
(4;202,301). 

5. An image conversion apparatus according to 
Claim 1, wherein said image decoder (1) com- 
prises: 

variable length decoder means (11) for de- 
coding said primary compressed image data in 
variable length; 

inverse quantizer means (12) for inverse 
quantizing the decoded image data for produc- 
ing an inverse quantized image data; 

inverse DCT processor means (13) for ex- 
ecuting an inverse DCT operation of the in- 
verse quantized image data in units and for 
generating conversion coefficients; 

adder means (13')' for adding said conver- 
sion coefficients with a predicted image data, 
and for producing a decoded image data with 
a plurality of conversion coefficients; 

memory means (14) for storing said de- 
coded image data of one unit; and 

compensation means (15) for generating 
said predicted image data which is applied to 
said adder means, whereby said adder means 
continuously produces decoded image data. 

6. An image conversion apparatus according to 
Claim 5, wherein said variable length decoder 
means (11) generates side information includ- 
ing DCT mode information, motion compensa- 
tion information, and motion vector information, 
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said DCT mode information being applied to 
said inverse DCT processor means (13), said 
motion compensation information being ap- 
plied to said compensation means (15), and 
said motion vector information being applied to 5 
said memory means (1 4). 

7. An image conversion apparatus according to 
Claim 1, further comprising a source of said 
primary compressed image data An. 10 

8. An image conversion apparatus according to 
Claim 7, wherein said source is a broadcasted 
compressed image data An. 

75 

9. An image conversion apparatus according to 
Claim 7, wherein said source is a memory 
means. 

10. An image conversion apparatus according to 20 
Claim 1, further comprising a second image 
coder (3; 3A; 3B) having a second resolution 
converter means (40; 4, 34; 301 ) for converting 

the decoded image data Rn, input thereto from 
the image decoder, to a second secondary 25 
compressed image data Bn2 having a third 
degree of resolution, and outputting the second 
secondary compressed image data Bn2. 

11. An image conversion apparatus according to 30 
Claim 1, further comprising selecting means 

(61) for manually selecting a desired degree of 
resolution of said first resolution converter 
means. 

35 

12. An image conversion apparatus according to 
Claim 10, further comprising selecting means 
(61) for manually selecting one of said first and 
second resolution converter means. 

40 

13. An image conversion apparatus according to 
Claim 5, wherein said resolution converter 
means comprises: 

a plurality of coefficient selectors each for 
selecting from among the conversion coeffi- 45 
cients output by said adder means (13') a 
predetermined number of conversion coeffi- 
cients corresponding to a particular image res- 
olution; and 

a plurality of variable length coders each 50 
for variable length coding the data from the 
plurality of coefficient selectors. 

14. An image recompression method comprising 

the steps of: 55 

inverse quantizing a compressed image 
data (a), that has been previously quantized by 
a first quantization parameter (q) ( by the use of 



said first quantization parameter (q) to gen- 
erate a first inverse quantized image data (b); 

subtracting a compensation signal (z) 
based on a previous image data from said first 
inverse quantized image data (b) and for pro- 
ducing a difference data (b') f 

requantizing said difference data (b*) using 
a second quantization parameter (qN), and for 
generating a requantized image data (c); 

reinverse quantizing said requantized im- 
age data (c) using said second quantization 
parameter (qN) to generate a second inverse 
quantized image data (d); and 

adding to said second inverse quantized 
image data (d) said compensation signal (z) 
and further subtracting said first inverse quan- 
tized image data (b) to generate a compensa- 
tion signal (z*) of the next image data. 

15. An image recompression method comprising 
the steps of: 

inverse quantizing a compressed image 
data (a), that has been previously quantized by 
a first quantization parameter (q), by the use of 
said first quantization parameter (q) to gen- 
erate a first inverse quantized image data (b); 

subtracting a compensation signal (z) 
based on a previous image data from said first 
inverse quantized image data (b) and for pro- 
ducing a difference data (b f ), 

requantizing said difference data (b') using 
a second quantization parameter (qN), and for 
generating a requantized image data (c); 

reinverse quantizing said requantized im- 
age data (c) using said second quantization 
parameter (qN) to generate a second inverse 
quantized image data (d); and 

subtracting said difference data (b f ) from 
said second inverse quantized image data (d) 
to generate a compensation signal (z*) of the 
next image data. 

16. An image recompression method comprising 
the steps of: 

subtracting a compensation coefficient 
generated according to a previous image data 
from a first conversion coefficient block con- 
tained in a compressed orthogonal transform 
image data to generate a second conversion 
coefficient block; 

extracting a predetermined number of co- 
efficients from said second conversion coeffi- 
cient block to generate a third conversion co- 
efficient block; and 

generating a difference coefficient block 
using said third conversion coefficient block 
and said first conversion coefficient block, said 
difference coefficient being use as a compen- 
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sation coefficient of the next image data. 

17. An image recompression method as claimed in 
Claim 16, further comprising the step of adding 
a compensation coefficient generated from the 
past image data to the third conversion coeffi- 
cient block, before the generating step. 

18. An image recompression apparatus compris- 
ing: 

variable length decoder means (110) for 
decoding from a coded image input data, a 
first quantization parameter (q), a compressed 
image data (a), that has been previously quan- 
tized by a first quantization parameter (q) t and 
other information data; 

first inverse quantizer means (130) for in- 
verse quantizing said compressed image data 
(a) by the use of said first quantization param- 
eter (q) to generate a first inverse quantized 
image data (b), 

first subtractor means (210) for subtracting 
a compensation signal (z) based on a previous 
image data from said first inverse quantized 
image data (b) and for producing a difference 
data (b 1 ), 

quantizer means (1 40) for requantizing 
said difference data (b f ) using a second quan- 
tization parameter (qN), and for generating a 
requantized image data (c); 

second inverse quantizer means (170) for 
reinverse quantizing said requantized image 
data (c) using said second quantization param- 
eter (qN) to generate a second inverse quan- 
tized image data (d); 

adder means (220) for adding to said sec- 
ond inverse quantized image data (d) said 
compensation signal (z) and for generating a 
sum data (e); 

second subtractor means (230) for sub- 
tracting said second inverse quantized image 
data (d) from said sum data (e) to generate a 
compensation signal (z*) of the next image 
data; 

memory means (180) for storing said com- 
pensation signal (z 1 ); 

variable length coder means (1 50) for con- 
verting said second quantization parameter 
(qN) and said requantized image data (c) to 
variable length code, and producing said vari- 
able length code; 

multiplexer means (160) for multiplexing 
said variable length code and said other in- 
formation data to generate a compressed cod- 
ed image input data. 

19. An image recompression apparatus according 
to Claim 18, wherein said memory means 



10 



(180) comprises: 

an inverse orthogonal transform processor 
means (182) applying an inverse orthogonal 
transform to said compensation signal (z') 
which is in a form of a coefficient difference; 

coefficient difference memory means (184) 
for storing said coefficient difference; and 

orthogonal transform processor means 
(186) for applying an orthogonal transform to 
the coefficient difference. 



20. An image recompression apparatus according 
to Claim 18, further comprising: 

inverse orthogonal transform processor 
is means (240) provided in association with said 

first inverse quantizer means (130) to generate 
said first inverse quantized image data (b) in 
an inverse orthogonal transformed format; 

orthogonal transform processor means 
20 (250) provided in association with said subtrac- 

tor (210) for generating said difference data 
(b') in an orthogonal transformed format; 

reinverse orthogonal transform processor 
means (260) provided in association with said 
25 second inverse quantizer means (1 70) for gen- 

erating said second inverse quantized image 
data (d) in an inverse orthogonal transformed 
format. 

30 21. An image recompression apparatus compris- 
ing: 

variable length decoder means (110) for 
decoding from a coded image input data, a 
first conversion coefficient block (a), and other 

35 information data; 

first subtractor means (210) for subtracting 
a compensation coefficient (z), based on a 
previous image data, from said first conversion 
coefficient block (a) to generate a second con- 

40 version coefficient block (a*); 

selector means (140) for selecting a pre- 
determined number of coefficients from said 
second conversion coefficient block (a*), and 
forming a third conversion coefficient block (u); 

45 adder means (220) for adding to said third 

conversion coefficient block (u) said compen- 
sation coefficient (z) and for generating a sum 
data (w); 

second subtractor means (230) for sub- 
50 tracting said first conversion coefficient block 

(a) said sum data (w) to generate a compensa- 
tion coefficient (z') of the next image data; 

memory means (180) for storing said com- 
pensation coefficient (z*); 
55 variable length coder means (150) for con- 

verting said third conversion coefficient block 
(u) to variable length code, and producing said 
variable length code; and 
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multiplexer means (160) for multiplexing 
said variable length code and said other in- 
formation data to generate a compressed cod- 
ed image input data. 

5 

22. An image recompression apparatus according 
to Claim 21, wherein said memory means 
(180) comprises: 

an inverse orthogonal transform processor 
means (182) applying an inverse orthogonal 10 
transform to said compensation coefficient (z 1 ) 
which is in a form of a coefficient difference; 

coefficient difference memory means (184) 
for storing said coefficient difference; and 

orthogonal transform processor means 15 
(186) for applying an orthogonal transform to 
the coefficient difference. 

23. An image recompression apparatus according 

to Claim 18 t further comprising switching 20 
means (360) for selectively producing either 
one of said coded image input data and said 
compressed coded image input data, and stor- 
ing means (340) for storing the selected data. 

25 

24. An image recompression apparatus according 
to Claim 21, further comprising switching 
means (360) for selectively producing either 
one of said coded image input data and said 
compressed coded image input data and stor- 30 
ing means (340) for storing the selected data. 

25. An image conversion apparatus according to 
Claim 1, wherein said image decoder (1) gen- 
erates side information including DCT mode 35 
information, motion compensation information, 

and motion vector information, which are ap- 
plied to said first image coder (2). 
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the real-time image data Rn to compressed image data 
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ent spatial or temporal resolution different from that of 
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The Search Division considers that the present European patent application does not comply with the 
requirements of unity of invention and relates to several inventions or groups of inventions, namely: 

1. Claims: 1,2,4,7-9 

Image conversion apparatus for converting compressed data, 
comprising a resolution converter, wherein said resolution 
converter is a spatial resolution converter means. 



2. Claim : 3 

Image conversion apparatus for converting compressed data, 
comprising a resolution converter, wherein said resolution 
converter is a temporal resolution converter means. 



3. Claims: 5,6,25 

Image conversion apparatus for converting compressed data, 
comprising a resolution converter with a decoder which 
comprises compensation means for generating predicted Image 
data which is applied to adder means that continuously 
produces decoded image data, and comprises variable length 
decoder means that generates side information including 
motion information. 



4. Claims: 10,12 

Image conversion apparatus for converting compressed data to 
secondary compressed data Rn, comprising two resolution 
converters which each receive Rn as input. 



5. Claim : 11 

Image conversion apparatus for converting compressed data, 
comprising a resolution converter and comprising selecting 
means for manually selecting a desired degree of resolution 
of the resolution conversion. 



6. Claim : 13 

Image conversion apparatus for converting compressed data, 
comprising a resolution converter with a decoder which 
comprises compensation means for generating predicted image 
data which 1s applied to adder means that continuously 
produces decoded image data, and comprises a plurality of 
coefficient selectors each for selecting from among the 
conversion coefficients output by said adder means a 
predetermined number of conversion coefficients 
corresponding to a particular image resolution. 
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The Search Division considers that the present European patent application does not comply with the 
requirements of unity of invention and relates to several inventions or groups of inventions, namely: 



7. Claims: 14,15,18,19,23 

Image recompression method comprising the steps of 
requantlzing a difference signal obtained from previous 
image data, reinverse quantizing said requantized image 
data, and adding or subtracting further data to generate a 
compensation signal for next Image data. 



8. Claims: 16,17,20,21,22,24 

Image recompression method comprising the steps of 
extracting, from a conversion coefficient block, a 
predetermined number of coefficients. 
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